LP-BOUNDEDNESS OF FLAG KERNELS 
ON HOMOGENEOUS GROUPS 
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Abstract. We prove that the flag kernel singular integral operators of Nagel-Ricci- 
Stein on a homogeneous group are bounded on , 1 < p < oo. The gradation 
associated with the kernels is the natural gradation of the underlying Lie algebra. 
Our main tools are the Littlewood-Paley theory and a symbolic calculus combined 
in the spirit of Duoandikoetxea and Rubio de Francia. 



1. Introduction 

Flag kernels on homogeneous groups have been introduced by Nagel-Ricci-Stein [S] 
in their study of quadratic Ci?-manifolds. They can be regarded as a generalization of 
Calderon-Zygmund singular kernels with singularities extending over the whole of the 
hyperspace xi = 0, where xi is the top level variable. The definition is complex (see 
below), as it involves cancellation conditions for each variable separately. However, the 
descritption of flag kernels in terms of their Fourier transforms is much simpler and 
bears a striking resemblance to that of the symbols of convolution operators considered 
independently by the author (in, e.g. 

In Nagel-Ricci-Stein [8] we find an LP-boundedness theorem for the very special flag 
kernels where the associated gradation consists of commuting subalgebras of the under- 
lying Lie algebra of the homogeneous group. The natural question of what happens if 
the gradation is the natural gradation of the homogeneous Lie algebra is left open. The 
aim of this paper is to answer the question in the affirmative. We prove that such flag 
kernels give rise to bounded operators. 

The smooth symbolic calculus mentioned above has been adapted to an extended class 
of flag kernels of small (positive and negative) orders and combined with a variant of the 
Littlewood-Paley theory built on a stable semigroup of measures with smooth densities 
very similar to the Poisson kernel on the Euclidean space. The strong maximal function 
of Christ [Ij is also instrumental. The approach has been inspired by the well-known 
paper by Duoandicoetxea and Rubio de Francia [2]. The dependence of the present 
paper on Duoandicoetxea and Rubio de Francia [5] is evident throughout. 

The class of flag kernels dealt with here is in fact an algebra. For this the reader is 
referred to [5] where also the L^-boundedness of flag kernels is proved solely by means 
of the symbolic calculus. 

After this paper had been completed, a preprint of Nagel-Ricci-Stein- Wainger Singular 
integrals with flag kernels on homogeneous groups I, has been made available, where the 
LP-boundcdness theorem for flag kernels is proved. This comprehensive treatment of flag 
kernels on homogeneous groups has been announced for some time. Professor Stein has 
lectured a couple of times on the subject, see, e.g. [5]. The authors also use a version 
of Littlewood-Paley theory but otherwise the approach differs from the one presented 
here in many respects, the most important being our use of the symbolic calculus and 
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partitions of unity related to a stable semigroup of measures. That is why we believe 
that what is presented here has an independent value and may count as a contribution 
to the theory. 

2. Preliminaries 

Let be a nilpotent Lie algebra with a fixed Euclidean structure and q* its dual. Let 
dtx = tx, t > he a family of dilations on g and let 

Qj = {xGq: 6tx = -x}, 1 < j < d, 

where 1 = pi < p2 < ■ ■ ■ < Pd- Denote by 

Qj = pj ■ dim Qj 

the homogenous dimension of Qj . The homogeneous dimension of Q is 

d 

We have 

(2.1) B = 00„ r = 00l 

and 

fr. n 1 r- / if ft +PJ =ft' 

where V = {pj ■ 1 < j < d}. 
Let 

d 

x^lxl^Y^W'^jW'^"' 

be a homogeneous norm on q smooth away from the origin. Let also 

\x\j = \{xi,X2,...,Xj,0,...,0)\, l<j<d. 
In particular, |a;|i = |a;i|, and \x\d = \x\. Another notation will be applied to q*. For 

1^1, = |(0,...,0,O,C,+i,...,Cd)|, l<j<d. 
In particular, |^|i = |^|, and = 

We shall also regard as a Lie group with the Campbell-Hausdorff multiplication 

xy = X + y + r{x,y), 

where r{x, y) is the (finite) sum of terms of order at least 2 in the Campbell-Hausdorff 
series for g. Under this identification the homogeneous ideals 

j=k 

are normal subgroups. 

In expressions like or a;" we shall use multiindices 

a = (ai,a2, • • ■,ad), 

where 

Q!fe = (afei,afei,---,afenj, rik = dimflfc = diingl, 
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are themselves multiindices with positive integer entries corresponding to the spaces Qk 
or 0^. The homogeneous length of a is defined by 



d 



'^\o^k\, \ak\ = Pkictkl + ak2 ~\ l-ttfcnj- 



k=l 

The Schwartz space of smooth functiions which vanish rapidly at infinity along with 
their derivatives will be denoted by S{g). For a tempered distribution K, that is a 
continuous linear functional on S{q), we shall write 

{KJ) = f fix)K{x)dx, /e5(0), 

without implying thereby that if is a locally integrable function. 

Even though the flag kernels are our prime concern here we need a broader class of 
kernels to properly deal with them. In [2, we proposed a natural generalization of the 
flag kernels of Nagel-Ricci-Stein. Let 

||/||(,.)= max sup{l + \x\f>'+'\D'^f{x)\ 

|a|<Qfc + l xegk 

be a flxed norm in the Schwartz space S{gk)- Let 

= {u = {1^1,1^2, .■.,Vd) ■ kfcl <Qk, 1 < < d}. 

Let e M. We define the class J-i^) by induction on the homogeneous step d. When 
d — the elements of ^-"(0) are simply constants. If d > 1, we say that a distribution 
K e is in J-"(z/) if it is smooth away from the hyperspace xi = and satisfies the 

following conditions: 

i) For every multiindex a, 



(2.2) \D°'K{x)\ <Cc,\x\; 

for xi ^ 0; 

ii) For any 1 < k < d, 



X 



d 



(2.3) < Kii,^,f >= R I ip{Rxk)fixi,. . . ,Xk-i,Xk+i, - ■ ■ ,Xd)K{x)dx 

J 3 

is in T{v{k)) on ®j^kQj-, where V(^k) = {vi, ... , Vk-i,Vk+i, • • ■ , Vd), and this is uniform in 
If G '5(fli) with |(p||(fc) < 1 and i? > 0. (Note that the meaning of uniform boundedness 
of a family of members of J^{iy) is obvious in the case d = and, for d > 1, can be defined 
by induction.) 

For every N, we define a norm || • H^^jv in J'i^) as the maximum of all the bounds 
occurring in the definition. First, we let 

d 

s'^^iP) = max sup FT \x\^''+'"'+^°"'^\D°'K{x)\. 

and, if d = 1, 

\\K\U.N = s''j^{K)+ sup suvR-'''\<K,ipoSR>\. 

|v||(i)<lfl.>0 

If d > 1, we let 

\\K\\^^N ^ s^i^iK) + ma.x sup anp\\Kii^^\\^ n- 
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Thus, J-iv) can be regarded as a locally convex topological vector space. Let us remark 
that J^(0) = ~^(0, 0, . . . , 0) is exactly the class of flag kernels of Nagel-Ricci-Stein [5] (see 
Corollary 3.7 of [7). 
For a if e S*{g), let 

<KJ>= f fix-')K{dx), feSis). 
•'a 

The following three propositions have been proved in [6] and [7]. 

2.4. Proposition ((Theorem 2.5 of 6 )). Let K £ ^(0) he a flag kernel on q. The 
convolution operator f ^ f * K defined initially on S{g) extends uniquely to a hounded 
operator on L'^{g). 

2.5. Proposition ((Proposition 1.5 of [7 )). Let v g M . A distribution K is in J-{v) if 
and only if its Fourier transform is locally integrahle, smooth for S,d 0, cind satisfies 

(2.6) |Z)«%)| <a|?|^^-l"^l...|e|^''"'"^', U^O. 

Cf. also the original Theorem 2.3.9 of Nagel-Ricci-Stein 8 for kernels K e -^(0). 

2.7. Proposition (Theorem 4.8 of 7 ). Let pL,v + ^ e M . Let K e J^iv), L e J^(/i). 
Let tp — ®f.^ifk G C^(0) he equal to 1 in a neighbourhood of 0. There exists a P = 
Pk,l G ^{i^ + /^) such that 

P ^ \imK,-kL 

in the sense of distributions, where 

< K,, f>=[ ^{ex)f{x)K{dx), f G S{q). 



Moreover, the mapping (K, L) — )> Pk,l is continuous. 

3. Semigroups of measures 

Following Folland-Stein [3] , we say that a function ip belongs to the class Tl{a) , where 
a > 0, if it is smooth and 

(3.1) |L>"(p(x)| < C„(l + |a;|)-'3-"-l"l, aha. 

3.2. Proposition. Let p e TZ{a) for some < a < 1 and let J ip ^ 0. Then p e F{a). 

Proof. The size condition (|2.2p follows by p.ip . To verify the cancellation condition (|2.3p 
let / e S{q) and i? > 0. Then 

f{Rx)v(x)dx^ I {f{Rx)- f{0))p,{x)dx 

<[ {fiRx)-f{0))cp{x)dx+ f {fiRx)-f{0))ipix)dx 

J\x\<R-^ J\x\>R-'^ 



< ll/l 



(i? / \x\-^-''+Ux + 2 [ Ixl-^-^dx] 

\ J|i|<_R-i J|x|>_R-i / 



<c^^"ll/ll, 

where 11 • 11 is a Schwartz class norm. □ 
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Let 

(P, f) = lim 1^^^^ (/(O) - fix)) / e 5(0). 

The distribution P is an infinitesimal generator of a continuous semigroup of probability 
measures with smooth densities 

where h e 7^(l) and P^h e n{N) for = 1, 2, . . . . In other words, 

hfkhs = ht+s, t,s > 0. 

and 

The operator Pf = f -k P is essentially selfadjoint with S{g) for its core domain. The 
reader is referred to j4j for proofs and details. 
For < a < 1 

^ r°° ^ 



(3.3) {P-J) = ,^-I t-'--{6o-ht,f)dt= ^ / t--{PhtJ)dt 

defines a homogeneous distribution smooth away from the origin (cf., e.g. Yosida [lOj). 
3.4. Proposition. For every < a < 1, 

P^h e TZ{a) and / P^hix) dx = 0. 

Proo/. By ([53]) . 

r(i - a) 7o 



whence 



r(i - a) Jo 



Ca f°° t-" dt 



as required. 

Now, for every i > 0, 



Therefore, 



r(l-a)7o (t + l + |.t|)Q+i+I"I 
<C' / - -- (1 + bh-^-i-l"! 

/•oo Jj- 

< c" / - - fl + bir'^"''"!"! 



hi dx — 1 . 



P/if dx = --^ I htdx ^ 0, t>0. 



dt 

which combined with p.3p gives the second part of the assertion. □ 
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4. Littlewood-Paley theory 

From now on we fix the function ip — 

4.1. Remark. By tlie resuits of tlie previous section, </? is a smooth function satisfying the 
estimates 

(4.2) ID^'vix)] < + la;|)-Q"i/2-|«|^ 

Moreover, tp 6 T{l/2). 
4.3. Lemma. We have 



f 



f°° dt 
Jq e 



Proof. By the semigroup properties, 



'^f*ht = f-kPht:^jf* {ipt ★ (ft), 



whence 

dt 



Now, if e — > and Af — > cxo, the expression on the right hand side tends to / in the sense 
of distributions. □ 

Let T = (ti,. . . ,td) S We shall regard as a product of copies of the multi- 
plicative group ii^. We shall write 

r'^ = (i?,...,t^), TS^{hs^,...Ms,), ^^^^llll^, 

1 tl . . .td 

Let ipk be the counterpart of (p for g replaced by g'^'''^ 1 < fc < d. Let 

*A; = 4 y'fc, 

where (5fc stands for the Dirac delta at £ Let 

$ = $1 * $2 ★ • • ■ ★ 

and 

$T = ($ik*---*($<i)t,, Teil^ 

4.4. Corollary. We have 

$ e |.F|(l/2) fl .F(ei/2,...,e,/2). 

ee{-i,i} 

/= / /*$T*$T^, /e5(g). 

Proof. By Remark |4. II 

$fe e.F(0,... 0,1/2,0,..., 0)n.F(0,... 0,-1/2,0,..., 0), 

where the only nonzero term stands on the fc-th position. Therefore the first part of our 
assertion follows by Proposition 12. 71 The second one is a consequence of Lemma □ 



Furthermore, 
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4.5. Proposition. The Paley-Littlewood square function 

/ \ 1/2 

G*(/)(x)= \f^^rix)\'^j , 

is bounded as an operator on LP(q). In other words, for every 1 < p < oo, there is a 
constant C^,p > such that 

\\G^if)\\p<C^Jf\\p, /e5(0). 

Proof. The proof is implicitly contained in Folland-Stein 3 (see Theorem 6.20.b and 
Theorem 7.7) so we dispense ourselves with presenting all details. 

We start with defining some Hilbert spaces and operators. Let Xq = C and 

~T 

For a given a; £ g, let Fk{x) : Xk-i Xk be given by 

Fk{x)m{ti,. . .,tk-i,tk) = {ipk)t^{xk, ■ ■ ■,Xd)m{ti,. . .,tk-i). rn £ Xk-i- 
Finally, let Wk ■ Cc{q, Xk-i) Co{Q,Xk) be the operator 

Wkf{x){T,tk)^{f^Fk){x){T,tk)^ f {^k)tAy)f{xy){T)dy, 

where T = (ii, . . . , tk-i). Note that Wk acts only on (xk, ■ ■ ■ , a;d)-variable. 
We claim that 

Wk:L^{Q,Xk-i)^L^{g,Xk) 
is an isometry. In fact, by definition of 

2 _ / IITI/ -f('^M|2 



Xk=L^{R+,^), l<k<d. 



rX-' T Jo t 

dT f°° dt „ , ^ ^ „ , ^ ^ II »i|2 



\\Wkf\\h^,^x, = / \\Wkf{x)\\i,^dx 

Jo t Jr\-^ T J^(k) 
dT f°° dt , , 

'{Vk)t{y)f{xy){T)\^ dydx, 

rj. , , < /T*($fc)t,/T*(*fe)t >= I|/I|i2(,.X,_i)' 

Jo '' 

where frix) = f{x){T). 

Another property of Wk that is needed is the following. For every a 

(4.6) \\D-Fkix)\\^x,_^^x,)<Co.\x\-'^-^"^. 
This follows readily from (|4.2I) specialized to ipk- 

|i?>fe(a;)| <C„(l + |a;|fe)-«-i/2-l«l. 

As a bounded operator from L'^{Q,Xk-i) to L^{Q,Xk) satisfying (j4.6l) is Wk a vector- 
valued kernel of type 0, and, by Theorem 6.20.b of Folland-Stein [3 , maps LP{g, Xk-i) 
into LP{Q,Xk) boundedly for every 1 < p < oo. 
This implies our assertion. In fact, 

G*(/)(x) = \\f*F,*---^Fd{x)\\x„ 

and therefore 

I|G*(/)IIlp(b) = mT,-,...T,f\\L.^g^x,)<C\\fh.i,,Xo)^C\\f\\p. 



8 



P. GLOWACKI 



□ 

A word of comment on the symbol would be appropriate here. The notation may 
suggest that the functions are dilates of a single function. They are not, but they 
have estimates of this form, which is our justification. The same applies to the symbol 
Kt below. In the next section we are going to use the same notation for the "real" 
dilates of a function. We hope the reader will not get confused. 



5. The strong maximal function 
For a function F on g and a T G R^, let 

Ft(x) = F^t,,t,,...t,){x) = t-'^H-^' . ..t-'^'F{hxi,t2X2, . . .,tdXd). 
The strong maximal function on g is defined by 



M/(x)= sup / \fixiTy)-')dy = sup\f 

T&R±J\y\<l T 



* iXB)Tix)\, 



where xb stands for the characteristic function of the unit ball B — {x € g : \x\ < 1}, 
and Ty = {tiyi, . . . , tdyj.)- A theorem of Michael Christ asserts that for every 1 < p < oo 
there exists a constant C > such that 

\\Mf\\p<C\\f\\p, feL^Q), 

that is, M is of {p,p) type (see Christ [T]). 

We shall need the following corollary to the Christ theorem. Let 

7(t) = min{i,<"i}, t > 0. 

5.1. Corollary. Let 

F(x)=^^ll7(|a;,|nx,r«^ x ^ 0, 
for some a > O.Then the maximal fuction 

MFf{x)= sup |/*Ft(x)| 

is of {p,p) type for 1 < p < oo. 

Proof. Let Bj be the unit ball in Qj and let \Bj\ be the Lebesgue measure of Bj. Let 
D ~ Bi X ■ ■ ■ X Bd- Then for every simple positive function h < F oi the form 



h{^) = ^CRXDiR ^x), i? = (ri,r2, . . . ,r<i) e fi' 

R 

we have 

\D 



R 

and therefore 



\D\ 

which completes the proof. □ 



Mpfix) < -j^Mfix), 
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6. Flag kernels 
We keep the notation established in previous sections. 
6.1. Lemma. Let 

Then Kt,s G -^(0) uniformly, and satisfy the estimates 
(6.2) \D"KtAO\ < C„7(5)i/2|e|H"il . . . 

where 

j{S) = 7(51)7(52) • ■■j{sd)- 

Proof. By the first part of Corollary 14.41 $t £ 1-^1(1/2) with bounds uniformly propor- 
tional to 7(T)i/2. Note that 

7(T5)<7(r)-7(^)- 

Thus, our assertion follows by Proposition 12. 71 □ 
We let 

6.3. Lemma. For every T, Kt is an integrable function, and the maximal operator 
(6.4) Kif{x)=snp\f*\KT\ix) 

T 

is of type (p, p) for all I < p < 00. 

Proof. Observe that by Proposition 12.41 Kt G ^^(s) so it is a function. Moreover, by 
Corollary 14.41 and Proposition 12. 7[ it is a smooth away from xi = 0, and satisfies 

|AT(:.)|<C7(r)i/27(Ni)'/'Nr'^^-.7(NU)^/'k|7'5'^ 
uniformly in T so that Kt < CFt, where Ft is a dilate of 

i^(x) = 7(Nli)'/'klr^^ • •7(N.)'/'kl^^^ 



This shows that Kt is integrable. The second part of our claim follows by Corollary 15. II 
and the above. □ 

We turn to the main result of this paper. The reader may wish to compare the proof 
we give with that of Theorem B and the preceding lemma of Duoandicoetxea-Rubio de 
Francia 

6.5. Theorem. Let K be a flag kernel on q. Then the singular integral operator 

f-^f*K, feS{g), 
extends uniquely to a bounded operator on LP{q) for all 1 < p < 00. 
Proof Let f,h e S{q). We have 

<f*K,h>=[ ^[ ^ < f-k^T,h*^TS*^TS*K-k<i>T> 
JR± ^ JR± ^ 



dS r dT 



S Jud^ T 



< fr, hTs * Kt,s >, 



where 

fT = f*^T, hTS — h-k^TS, Kt.s — '^TS * K -k ^T- 
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We are going to estimate 



dT 



< Lsf, h>= -7^ < fr, hrs * Kt,s > 



T 



for a given S. Let us start with i^-estimates. We have 

1/2 



< Lsf, h>\< 



sJRl 



dT 



1/2 



By (|6.2p and Proposition 12.41 the operators / — > f * Kt.s are bounded with norm 
estimates uniformly proportional to 7(6')^/^ so that, by Proposition 14.51 



I < Lsf, h>\< Cj{Sf/^ \\G^{f)h l|G$(/i)||2 
<C,^{Sy^'\\fh\\hh, 

that is, 

(6.6) ||i5/||2<Ci7(^)^/'||/||2, /e5(0). 

For 1 < p < 2 and f,h e S{g), 

1/2 / V 1/2 



< Lsf, h>\< 



dx 



<Ci||G*(/)||p 



\hTS*KT,six)\'^ ^ j 



q/2 



1/9 



dx 



2\\J\\p ■ 



\hTS*KT,s{-)\ ^ 



1/2 



q/2 



where l/p+l/q = 1. Note that q> 2. Thus, there exists a nonnegative function u with 
\\u\\r = 1, where 2/q + 1/r = 1, such that 



/ \hTs*KT,s{-)?'^ ^11 \hTS*KT,si^)\^^ 
JrX T JJj,.^ T 



u{x) dx. 



Now, 



hxs * Kt.S = {h-k $Ts) * i^TS * K -k $t) 

= {h-k ^TS * ^Ts) * {K -k ^t) — h'rps -k Kt- 

Recall also that, by Lemma [6.31 Kt are integrable functions. Therefore, by Lemma [6.31 



again. 



/ \h'rs*KT{-)\^'^ <cj [\h'Ts\'*\KT\{x)-u{x)dx^ 



< C2 



dT 

I^Ts(2^)P -jr ■ LClu{x) dx 



(6.7) 



< C3\\G^{h)\\l ■ \\Klu\\r < Ci\\h\\l 
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where we have used the estimate 

\h'rs*KT{x)\' < (^Jjh'rs{xy-')\ ■ \KT{y)\'/' ■ \KT{y)\"' dy^ 

< f \h'Ts?i^y-')-\KT\{y)dy f \KT{y)\dy 

< C\h'rrs\^*\KT\{x), 

the integrals 

/ \KTix)\dx < C 

being uniformly bounded, as can be seen from the proof of Lemma 16.31 Therefore, 
(6.8) \\Lsf\\p<C,\\f\l. 

Now, by interpolating between (j6.6p and (j6.8p . we get 

||is/||p<C27(5MI/||p, 
where > depends only on p, and, finally, 

\\f*K\\, <C,(^ J^^ j{Sr^ • ll/llp = C4l|/l|p, 

which proves our case for 1 < p < 2. The result for 2 < p < oo follows by duality. □ 
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